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Abstract 

We propose a reformulation of the convergence theorem of monotone numerical 
schemes introduced by Zhang and Zhuo |34] for viscosity solutions to path-dependent 
PDEs (PPDE), which extends the seminal work of Barles and Souganidis [I] on the 
viscosity solution to PDE. We prove the convergence theorem under conditions similar 
to those of the classical theorem in pQ. These conditions are satisfied, to the best of our 
knowledge, by all classical monotone numerical schemes in the context of stochastic 
control theory. In particular, the paper provides a unified approach to prove the con¬ 
vergence of numerical schemes for non-Markovian stochastic control problems, second 
order BSDEs, stochastic differential games etc. 

Key words. Numerical analysis, monotone schemes, viscosity solution, path-dependent 
PDE 

1 Introduction 

In their seminal work [I], Barles and Souganidis proved a convergence theorem for the 
monotone numerical schemes for viscosity solutions to fully nonlinear PDEs. Assuming 
that a strong comparison principle holds true for viscosity sub- and super-solutions 
of a PDE, they show that for all numerical schemes satisfying the three properties, 
“monotonicity”, “consistency” and “stability”, the numerical solutions converge locally 
uniformly to the unique viscosity solution of the PDE as the discretization parameters 
converge to zero. They mainly use the stability of viscosity solutions to PDEs and 
the local compactness of the state space. Due to their result, one only needs to check 
some local properties of a numerical scheme in order to get a global convergence result. 
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are also grateful to Ibrahim Ekren and Nizar Touzi for their helpful remarks and suggestions. 
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Also, their result and method are widely used in the numerical analysis of viscosity 
solutions to PDEs. 

It is well known that, by the Feynman-Kac formula, the conditional expectation 
of a random variable can be characterized by a viscosity solution of the corresponding 
parabolic linear PDE. This relationship has been generalized by the theory of back¬ 
ward SDE (corresponding to semi-linear PDE) and that of second-order backward 
SDE (corresponding to fully nonlinear PDE). However, these probabilistic tools have 
their PDE counterparts only in the Markovian case. Recently, a notion of viscosity 
solutions to path-dependent PDE (PPDE) was introduced by [Kj], which permits to 
study non-Markovian problems. In particular, it provides a unified approach for many 
Markovian, or non-Markovian stochastic dynamic problems, e.g. stochastic control 
problems, stochastic differential games, etc. 

It would be interesting to extend the convergence theorem of Barles and Souganidis 
[T in the context of PPDE. The main obstacle for a direct extension of their arguments 
is that the state space is no longer locally compact. Zhang and Zhuo [31] provided 
recently a formulation of the convergence theorem of monotone schemes for PPDEs. 
They mainly use the stability of the viscosity solution to PPDE, and overcome the 
difficulty of non-local compactness by an optimal stopping argument as in the well- 
posedness theory of PPDE. They also provide an illustrative numerical scheme which 
satisfies all the conditions of their convergence theorem. However, this illustrative nu¬ 
merical scheme is not applicable in the general case. Moreover, most of the monotone 
numerical schemes in the sense of Barles and Souganidis [I], for example the finite 
difference scheme, do not satisfy their conditions. 

Our main objective is to provide a new formulation of the convergence theorem for 
numerical schemes of PPDE. Our conditions are slightly stronger than the classical 
conditions of Barles and Souganidis [I], as PPDEs degenerate to be PDEs. Never¬ 
theless, to the best of our knowledge these conditions are satisfied by all classical 
monotone numerical schemes in the optimal control context, including the classical 
finite difference scheme, the Monte-Carlo scheme of Fahirn, Touzi and Warin |14| , the 
semi-Lagrangian scheme, the trinomial tree scheme of Guo, Zhang and Zhuo [16] , the 
switching system scheme of Kharroubi, Langrene and Pham [20], etc. Therefore, our 
result extends all these numerical schemes to the path-dependent case. In particular, 
it provides numerical schemes for non-Markovian second order BSDEs, and stochastic 
differential games, which is new in the literature, see also Possamai" and Tan [25lj . 

Similar to [33], we use an optimal stopping argument to overcome the difficulty 
of non-local compactness. Instead of looking into an optimal stopping problem of a 
controlled diffusion as in [34], we consider a discrete time optimal stopping problem of 
a controlled process. Therefore, our argument is quite different from that in [34]. 

The paper is organized as follows. In Section [2] we provide some preliminary nota¬ 
tions used in the paper. In Section [3] we recall the definition of viscosity solution to the 
path-dependent PDE, and present our main result, that is, a convergence theorem of 
monotone schemes for PPDEs. Further we compare with the result of Guo, Zhang and 
Zhuo [16] and that of Barles and Souganidis [T]. In Section [4] we review some classical 
monotone schemes for PDEs, and verify that they satisfy the technical conditions of 
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our main convergence theorem, and thus can be applied in the PPDE context. Finally, 
we complete the proof of the main theorem in Section [6j 

2 Preliminaries 

Throughout this paper let T > 0 be a given finite maturity, 17 := {w € C([0,T];M d ) : 
wo = 0} the set of continuous paths starting from the origin, and 0 := [0, T] x 17. We 
denote by B the canonical process on ST, F = {Et, 0 < t < T} the canonical filtration, 
T the set of all F-stopping times taking values in [0, T ], and Po the Wiener measure on 
17. Moreover, let T + denote the subset of r G T taking values in (0, T ], and for H G T, 
let Tu and be the subset of t G T taking values in [0,h] and (0, h], respectively. 

Following Dupire [9], we introduce the following pseudo-distance on 0: for all 

(t,w),(7',w') € 0, 

IM| := sup |w s |, d((t,u),(t',u')) := \t - t'\ + ||w tA . - w(, A .||. 

0<s<T 

Let E be a metric space, we say a process X : 0 —» E is in C°(@,E) whenever 
(t, w) i->- X t (u) is continuous. L°(J 7 , E) and L°(F, E) denote the set of all .^-measurable 
random variables and F-progressively measurable processes, respectively. We remark 
that C°(Q,E) C L°(F ,E), and when E = R, we shall omit it in these notations. We 
also denote by BUC(0) the set of all functions bounded and uniformly continuous 
with respect to d. 

For any A G Et, £ G L °(Et,E), X S L°(F, E), and (t,ui) € 0, define respectively 
the shifted set, the shifted random variable and the shifted process by 

A t,u := {u/ € 17 : ui <S>t ^ € ^4}, £, t,u (uj') := £(w <S>t w 7 ), X^iuj') := X(t + s, ui ®t u') 

where u> <8 H u' is the concatenated path defined as 

(w ®t u') s := w s l[ 0i t](s) + (ut + ^s_t)l(t,T]( s )> 0 < s < T. 

Following the standard arguments with monotone class theorem, we have the following 
results. 

Lemma 2.1. Let (t,uj) G 0 and s G [t,T]. Then A t,ul G E s —t f or oil A G E s , 
^ G L °{E s - t ,E) for all £ G L °{E S ,E), X G L°(F,F) for all X G L°(F,F), and 
T t,UJ — t G T s -t for all t £ T s - 

Next, let us introduce the nonlinear expectation. As in [12], we fix a constant 
L > 0 throughout the paper, and denote by V the collection of all continuous semi- 
martingale measures P on 17 whose drift and diffusion coefficients are bounded by L. 
More precisely, a probability measure P G V if under P, the canonical process B is a 
senrimartingale with natural decomposition B = A p + M p , where A p is a process of 
finite variation, M p is a continuous martingale with quadratic variation (M p ), such 
that A p and (M p ) are absolutely continuous in t, and 

ll/lloo, Halloo < L, where /rf := af := ^ , P-a.s. (2.1) 


3 




We then define the nonlinear expectations: 

£[■]:= sup E p [-] and £[•] := inf E p [-]. ( 2 . 2 ) 

p PEP 

3 Convergence of monotone schemes for PPDE 

3.1 Definition of viscosity solution to PPDE 

We introduce the following assumptions on a function G : 0 x R x R d x S d -> R {8 d 
is the set of all d x d symmetric matrices). 

Assumption 3.1. The function G : (t,ui,y, z,fi) G{t,uj,y, z, 7 ) satisfies that 

• G is non-decreasing in 7 ; 

• G is continuous in all arguments. 

Consider the PPDE in the following form 

— dtu(t,oj ) — G(-, u, d u u, d^u) (t, uj) = 0, for all (t, uj) € [0, T) x 0, (3.1) 

with the terminal condition u(T, •) = £. The path derivatives are defined as follows. 

Definition 3.2. We say that u € Cp 2 ( 0 ) if u € C 0 (©) and there exist processes 
A, Z, T € C°(0) valued in R, and respectively, such that: 

dut = + -Tj : d(B) t + Z t dB t , V — a.s. for all ¥ £ V. 

The processes A, Z and T are called the time derivative, spacial gradient and spatial 
Hessian, respectively, and we denote dtu := A, i := Z, df w u := T. 

In [TO] and the following works pa nu, the authors introduced a notion of viscosity 
solutions to PPDEs, by using the test functions in Cp 2 (0). Indeed, as observed in 
P 5 ], one does not need to consider all Cp 2 ( 0 ) test functions but only the paraboloids. 
For a £ R, ft £ R d , 7 € S d , we define the paraboloid on the real space: 

c /) a ’P<'y(t, x ) := at + (3 ■ x + —7 : (xx T ) for all ( t, x) £ R + x M d , 

where A\ : A 2 := Trf.A 1 .A 2 ]. We also abuse a little the notation to define the corre¬ 
sponding ‘paraboloid’ on the path space: 

fT'P’ 1 (t,uj) := 0 a ’^’ 7 (f,o;t), for all (f,cj) € 0 . 

Note that the path derivatives at the point (0,0) of the paraboloid are clearly: 

d t (t> o ,/3 ’ 7 = a, = P, and ^L ^’ 7 = 7 . 

The sub- and super-jets of a function u £ BUC(0) at (t,u) £ [0,T) x O are as 
follows 

Juft,iv ) := |(o:,/?, 7 ) : u(t,u) = max re 7 ^ for some S > oj, 

Ju(t,u) := |(a,/?, 7 ) : u(t,u) = min TG 7 ^ £\uf u — </>“’^’ 7 ], for some 5 > oj, 
where H^u/) := 5 A inf{s > 0 : |w'| > <5} £ T + ■ 
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Definition 3.3. Let u S BUC(0). 

(i) u is a V-viscosity subsolution (resp. supersolution) of the path dependent PDE 
dm if at any point € [0, T) x LI it holds for all (a, (3, 7 ) € Ju(t,u) (resp. 

Juft , u ;)) that 


—a — G(t, co, u(t, ui), (3, 7 ) < (resp. >) 0. 


(ii) u is a V-viscosity solution of the path dependent PDE (13.11) . if u is both a V- 
viscosity subsolution and a V-viscosity supersolution of m- 

For the arguments below, we need to introduce an equivalent definition using constant 
localization and test functions in C , Q ,2 (M + xR <i ), i.e. the class of all C 1,2 scalar functions 
c p of which the partial derivatives dtip, d x p, d xx p are of compact support. Consider the 
set of test functions: 

Au(t,oj) :={<£>£ Cq’ 2 (M + x M rf ) : ( u t,L0 — p)o = max5[ (u t,u — yLjJ, for some 6 > ol, 
1 tgT s J 

Au(t,uj) := € C'q’ 2 (M + x R d ) : {u t)U — tp )0 = min £_\(u t,UJ — <p) T ], for some <5 > o}, 

1 r&Ts J 

where we abuse the notation again, by denoting 

Proposition 3.4. A function u is a V-viscosity subsolution (resp. supersolution) of 
Equation (HID, if and only if at any point (f, ui) € [0, T)xfi it holds for all ip € Au(t, u) 
(resp. Au(t,u)) that 

£ t,UJ <Po := -d t <po - G(t,oj,u(t,uj),d x ipo,dl x ipo ) < (resp. >) 0. (3.2) 


We will report the proof of the above proposition in Section [ 6 j 

One of the motivations of the PPDE theory is to characterize the value functions 
of non-Markovian stochastic control problems. 


Example 3.5. Consider a second-order backward SDE (see e.g. Cheridito, Soner, 
Touzi and Victoir [5j, Soner, Touzi and Zhang [30j) with generator F : O x~RxW d xK —> 
M and the controlled process with diffusion coefficient a : QxK —>• Sd, where K is some 
set in which the control processes take values. Then the solution of the second-order 
backward SDE corresponds to a viscosity solution to the PPDE with the nonlinearity: 


G(t,u,y,z, 7 ) 


sup 

k&K 



(f, u,k) : 7 + F(t, u>, y, aft, u, k)z , k) 


(3.3) 


We refer to Section 4 of Ekren, Touzi and Zhang [12] for more details. Another example 
is the application of PPDEs in the stochastic differential games (see e.g. Pham and 
Zhang [24jl. where the nonlinearity of the PPDE is of the form: 


G(t,u,y,z, 7 ) 


sup inf ^-a 2 (t,ki,k 2 ) : j + F(t,u},y,a(t, k 1 ,k 2 )z,ki,k 2 ) 

ki£K! k 2e K 2 Lz 


(3.4) 
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3.2 Main results 


For parabolic PDEs with terminal conditions of the form (13.11) . the numerical schemes 
are usually given as a backward iteration. Let u h {T , •) = £(•), and then given the value 
of u h (t, •), we compute the value of u h {t — h, •). More precisely, we will introduce the 
numerical scheme as an operator T: for each (t,co) G [0, T) x D and 0 < h < T — t, 
is a function from L°(J r i+ / l ) to K, then the backward iteration is given by 

u h (t,u) := T ^h u t+ h . 


As illustrated by Kushner and Dupuis [2Tj, in the context of Markovian stochastic 
control problem, the numerical result u h can be interpreted as the value function of 
a controlled Markov chain problem, or equivalently the numerical scheme can be 
treated as a discrete time nonlinear expectation. Moreover, such an interpretation 
implies the monotonicity condition in sense of Barles and Souganidis [L. Inspired 
by this observation, we would like to introduce a discrete time version of nonlinear 
expectations of £ and £_, in preparation of our new formulation of the monotonicity 
condition in this general path-dependent context. 


Definition 3.6. Let {Ui,i > 1} be a sequence of independent random variables defined 
on a probability space (Cl,! 7 , P), such that each Ui follows the uniform distribution on 
[0,1]. Let h > 0, K be a subset of a metric space, <&h : K x [0,1] —>• R be a Borel 
measurable function such that for all k G K we have 


\t[$ h (k,U)}\ < Lh , Var (A;, U)\ < Lh and E [$ h {k,U) 3 ] < Lh 3/2 . (3.5) 

Denote the filtration F := {T\,i G N}, where T n := a{Ui,i < n}. Let K. = {v : 
Vih is Dj-measurable and takes values in K for all i G N}. For all u G 1C, we define 

X^:=0, = X^_ x)h + Shly^Ui) for i> 1. (3.6) 

Further, we denote by X h,l> : [0, T] x D —>• D the linear interpolation of the discrete 
process {X^ v , i G N} such that X^ u = X^ for all i. Finally, for any function 
p € L°(.F), we define the nonlinear expectation: 


£ h [p\ ■= inf^e/c E 


p(X h ’ v ) and £ h [<p\ := sup„ e)C E p(X h ’ u ) . (3.7) 


Let us now formulate the conditions on the numerical scheme T. 

Assumption 3.7. (i) Consistency: for every (t,ui) G [0,T) x D and ip G Cq’ 2 (M + x 

R d ), 


lim 

(t' ,uj' 0,0,0) 


ip(t',LU uj') + c— T* [( p(t' + h, •) + c] 

h 


o- (3.8) 


(ii) Monotonicity: there exists a nonlinear expectation £_ h as in Definition 13.61 such 
that, for any ip, G ifi^t+h) we have 

[y?] — > —h5(h) whenever inf £_ h [e ah (p — > 0. (3.9) 
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where 5 : M + —» R is a function such that lim /40 5(h) = 0. 

(iii) Stability: u h are uniformly bounded and uniformly continuous in (t,u), uni¬ 
formly in h. 


Remark 3.8. In practice, we can verify that the numerical scheme T satisfies another 
version of monotonicity condition: 


> inf £_ h [e ah (<p — ip) t,u ~\ - hS(h), (3.10) 


which implies indeed the monotonicity condition (13.91) . Moreover, under condition 
(13.101) . it is possible to weaken slightly the consistency condition (13.81) . with almost the 
same proof, to 


lim 


<p(t',u <g H J) - T^ ,u;0taJ [ip(t' + h, •)] 


= 


P 0 ■ 


Our main result is the following convergence of the monotone scheme for PPDE (13.11) . 


Theorem 3.9. Assume that 


• the nonlinearity G of PPDE m satisfies Assumption 17.11 and the terminal 
condition f is continuous; 

• the numerical scheme T satisfies Assumption \3. 7\ 

• the comparison of the viscosity sub- and super-solutions of PPDE (ED holds 
true, i.e. if u,v € BUC(0) are V-viscosity subsolution and supersolution to 
PPDE (13.11) . respectively, and u(T, •) < v(T, ■), then u < v on 0. 

Then PPDE (13.11) admits a unique bounded V-viscosity solution u, and 

u h —u locally uniformly, as h —» 0. (3-11) 


Here are some remarks on our main result. 


Remark 3.10. In the case of semilinear PPDEs, i.e. the nonlinearity G(0,y,z, 7 ) = 
^7 + F(0, y, z ), a comparison result is proved in Ren, Touzi and Zhang [2?] under quite 
general assumptions. As for viscosity solutions of fully nonlinear PPDEs, a comparison 
result was first proved in Ekren, Touzi and Zhang m for PPDE (13.11) under certain 
conditions. A recent improvement can be found in [28] . 

Remark 3.11 (Comparison with Zhang and Zhuo f33j). Let us compare our Assump¬ 
tion [37T] with that in [M|. Our condition (i) is weaker and thus easier to verify compar¬ 
ing to that in |53]. The essential difference is between our condition (ii) and theirs. Our 
condition (ii), although stated in a complicated way, is satisfied by all (to the best of 
our knowledge) classical monotone schemes in PDE context. We also emphasize that in 
[34] . a convergence rate has been obtained under additional smoothness conditions on 
the solution of PPDE. Without smoothness conditions, a convergence rate has been ob¬ 
tained for HJB PDEs using Krylov’s shaking coefficient technique. However, it seems 
not trivial to extend this shaking coefficient technique to the path-dependent case. 
Nevertheless, for a class of path-dependent stochastic control problems, a convergence 
rate has been obtained in [8] and [32], using strong invariance principle techniques. 
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Comparison with Barles and Souganidis’s theorem When a PPDE degen¬ 
erates to be a PDE: 

L u(t,x) := — dtu(t, x) — Go(-, u, d x u, d^. x u)(t, x) = 0, on [0, T) x R d ,(3.12) 

with the terminal condition u(T , •) = g. Note that the definition of viscosity solution 
to PDE is slightly different from that to PPDE recalled in Section 13.11 but under 
general conditions a viscosity solution to PDE (13.121) is a viscosity solution of the 
corresponding PPDE. 

Assumption 3.12. (i) The terminal condition g is bounded continuous. 

(ii) The function Gq is continuous and Go(t, x, y, z, 7 ) is non-decreasing in 7 . 

(iii) PDE (I3.12|) admits a comparison principle for bounded viscosity solution, i.e. if 
u,v are bounded viscosity subsolution and supersolution to PDE (13.121) . respectively, 
and u(T, •) < v(T, ■), then u < v on [0, T] x R d . 

For any t £ [t, T) and h £ (0 ,T — t\, let T|’ x be an operator on the set of bounded 
functions defined on M. d . For n > 1, denote h := ^ < T — t, t{ = ih, i = 0,1, • • • ,n, let 
the numerical solution be defined by 

u h (T, x) := g(x), u h (t,x) :=T t J f : [u h (t + h,-)], f € [0, T), i = n,■■■,!. 

Assumption 3.13. (i) Consistency: for any (t,x) £ [0, T) x R^ and any smooth 
function p> £ C 1 , 2 ([0, T) x M d ), 

(c + ip)(f,x') - T\f x [(c + + h, • 

(t' ,x' 0 , 0 ) h 

(ii) Monotonicity: T^ x [</?] < T^[V’] whenever <p < if. 

(iii) Stability: u h is bounded uniformly in h whenever g is bounded. 

(iv) Boundary condition: lim (t',x',h)-^(T, x ,o) uh {t'ix') = g{x) for any x £ W l . 

We now recall the convergence theorem of the monotone scheme, deduced from Barles 
and Souganidis p] in this context of the parabolic PDE (|3.12l) . 

Theorem 3.14. Let the generator function Gq in ()3.12l) and the terminal condition g 
satisfy Assumvtion \3. l£l and the numerical scheme T|’ x satisfy Assumvtion \3.13[ Then 
the parabolic PDE (13.121) has a unique bounded viscosity solution and u h converges to 
u locally uniformly as h —>• 0 . 


)] 


= L <p(t,x). 


Remark 3.15 (Comparison with Assumption 13.71) . (1) Assumption 13.71 (i) is the 
same as Assumption 13.131 (i) when the PPDE degenerates to a PDE. 

(2) Assumption 13.71 (ii) is stronger than Assumption 13.131 (ii). However, as we men¬ 
tioned at the beginning of this section, Kushner and Dupuis [21] studied the classical 
finite-difference scheme, and highlighted that the monotonicity condition is in fact 
equivalent to a controlled Markov chain interpretation, where the increments of the 
Markov chain satisfy (13.51) . Our formulation of the monotonicity in Assumption 13.71 























(ii) matches this observation. Moreover, the new monotonicity condition is satisfied by 
all classical monotone scheme, to the best of our knowledge, in the context of stochastic 
control theory. See our review in Section |4j 

(3) The stability condition in Assumption 13.71 (iii) is also stronger than Assumption 
13.131 (iii). Nevertheless, in the classical numerical analysis for parabolic PDE (13.12|1 . 
in order to check Assumption 13.131 (iv), one needs (explicitly or implicitly) to prove 
a uniform continuity property of numerical solutions uniformly on the discretization 
parameter, which leads to the same condition as in Assumption 13.71 (iii). See also our 
review in Section [fj 


4 Examples of monotone schemes 


We discuss here some classical monotone numerical schemes in the stochastic control 
context, and provide some sufficient conditions Assumption 13.71 to hold true. Let us 
first add some assumptions on the functions G and £ for PPDE ( 13. ID . 

Assumption 4.1. The terminal condition £ is Lipschitz in u, G is increasing in r y, 
and G is Lipschitz in ( y , z, 7 ): i.e. there is some constant C such that for all (t, u) € 0 
and ( y , z, 7), (y', z', 7') € M x R d x S d , 

G(t,u,y,z,j) - G(t,u,y,z',y) < c(\y-y'\ + \z - z' I + I 7 - 7 ' 


In this section, we denote tk := hk for h = At > 0. Given x = (x io , x tl , • • • , x tfc ) a 
sequence of points in R d , we denote by x E Q the linear interpolation of x such that 
x t . = x t . for all i. Further, for (t,oj) € 0, h > 0 and z € R d , we define a path 

( s 


(w <g>^ z) := uj (8 H z h 


where z Q : = 


—z, for 0 < s < h\ 
h 




for s > h. 


Let E be some normed vector space, then for maps if : 0 —>■ E, we introduce the 
norm |-0|o and \ 1 f \1 by 

Wo := sup m, u )\ and Wl := sup Wt ’“> “ ^^ 


(t,u. >)e© 


(t,u)^(t',u') l^tA- - w't'A -1 + I* — t '\ 1/2 


4.1 Finite difference scheme 

For simplicity, we assume that the state space is of dimension one (d = 1). Let Ax > 0 
be the space discretization size. For every € 0, h > 0 and J^+^-measurable 

random variable if : Ll —>• M, we define the discrete derivatives 


where 


V h if(t,u) := (• Vlif,T>lif,T>lif)(t,u ), 


TjO iu \ II ^ T)1 !U \ lf{u^Ax)-lf(u tA -) 

V h if{t,uj) := if(uj tA .), V h if(t,u) := - — -, 


and V\ifft,Lo) : = 


if(ui <8>t Ax ) — 2if{u t /\.) + if(u (—Ax)) 


Ax 2 
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Then an explicit finite difference scheme is given by 


^hWt+hl ■= u h (t + h,u tA .)+ hG(t,oj,V h u^ +h (t,uj)). (4.1) 


Proposition 4.2. Suppose that Assumption ^.l\ holds true and G is Lipschitz inuj, i.e. 
there is a constant C such that for all w,o/ and all (t, y, z, 7 ) € [0,T]xRx W l x Sd, 


G(t, u, y, z, 7 ) - G(t, u',y, z, 7 ) 


< C’H^A- — w tA- 


Assume in addition the CFL (Courant-Friedrichs-Lewy) condition, i.e. 


< fr|V 7 G | 0 < 1 
Ax 2 ~ 2 


(4.2) 


and that V 7 G > e for some small constant s > 0. Then Assumption \3 . 7| holds true for 
finite difference scheme m- In particular, the numerical solution u h is | -Holder in 
t and Lipschitz in uj, uniformly on h. 


Proof. We will check each condition in Assumption 13.71 For the simplicity of presen¬ 
tation, we assume that G is independent of y. Clearly, the argument still works if G 
is Lipschitz in y. 

(i) The consistency condition (Assumption 13.71 fill is obviously satisfied by (14.11) as in 
the non-path-dependent case. 

(ii) For the monotonicity in Assumption 13.71 (ii), let us consider two different bounded 
functions ip and if. Denote (j>:=<p — if, then by direct computation, 




\t,LJ r 


+ hfGyV^cf + G^cf + G^cf), 


where G y , G z and G 7 depend on (t,oj) and (ip,if), but are uniformly bounded by the 
Lipschitz constant L of G. Let b £ [-L, L] and e < a < |V 7 G|o be two constants, and 
f a,b be a random variable defined on a probability space (D,-F, P) such that 


]P(C a ’ 6 = 0) = 1 -b^-2a^, 

P(C a ’ 6 = Ax) = /'X 7 • and P(C“’ b =-Ax) = a 

The law of ( a,b is well defined for h small enough, because every term above is positive 
and the sum of all terms equals to 1 under condition (|4.2I) . Further, we have 

E [( a ' b ]=bh, Var[C a ’ b ] = ah, and E[|C a ’ 6 | 3 ] < |Ax| 3 < Ch 3/2 , (4.3) 

where the last terms follows by Ax ~ h^. 

Then let F^a, b, •) : M —>• [0,1] be the distribution function of C a,b and < h/ l (® ) b, •) : 
[0,1] —>• M be the generalized inverse function of Ff,(a, b, •), i.e. 


$ h {a,b,x) := inf{y : F h (a,b,y) > x}. 


(4.4) 


In view of (|4.3D . we may verify (I3.10|) . and the monotonicity condition of Assumption 
13.71 (ii) follows. 
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(iii) To prove Assumption 13.71 liiib we will prove that there is a constant C independent 
of h such that 

\u h (t,uj) — u h (t',u')\ < c(\\ujt/\- - w ' t , A .|| + y/\t' - f|^), V(t,u),(t',w')e8.(4.5) 
Let us first prove that u h is Lipschtiz in uj. Denote 


L h t : = 


u h (t, uj) — u h (t , u') 

su p —nT-777—n—MiiwtA-wjj^o}- 

(t,w),((',u')ee INa- - UtA-W 


By direct computation, we have 

u h (t,u) - u h (t,J) = hG u \\u tA . - 4 a-II + Dh u t+ h (t,u) - D^u^ +h {t,uj'), (4.6) 


where 


Dh u t+h. {{^ + hGy)Vh + hG z V\ + hG 1 Vfyv!l +h , 


with G y , G z and G 7 uniformly bounded by L. Then there is a constant C independent 
of h such that 

L h t < (1 + Ch)L h t+h + Ch. 

Notice that the terminal condition £ is Lipschitz, it follows by the discrete Gronwall 
inequality, we have L% < Ce CT for a constant C independent of h. Hence, there is a 
constant C' independent of h such that 


\u 


(t,u) — u h (t,uj')\ < C'll^tA- — c* 4 A -II, Vt € [0,T], Wjw'ell. (4.7) 


We next consider the regularity of u h in t. Let t := ih and t' := jh > t. Note that 
u h (t, (jo) = u h (t + h, u>t/\.) + hG(t , u>, 0, 0,0) + /i(G(t, cu, UhUt +h (t, cu)) — G(t, w, 0,0,0)). 
By a direct computation, we have 


u h (t,u ) = E 


i- 1 


G(tfc, w <8>i A’ /l , 0,0,0) h + u h {t'®t X h ) 


_ 


(4.8) 


where X h is a discrete process defined as Xq := 0, 

Xt h+1 ■= x t + * h (V^G,V z G,U k+1 ), 

with 4>/j be given by (14.41) . and X h is the linear interpolation of X h . Define 


k -1 


A h 0 := 0, A't k :=Y J ^[®h{X 1 Gy z G,U i+1 )\Fi], and M h := X h — A h 


i =0 


Clearly, M h is a martingale and A h is a predictable process. Further, it follows from 
the property of &h in (|4.3I) that 


E 


A 1 ! - A:? 

t k +1 Cfc 


< Lh and Var 


K + i - K 


< Lh. 
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Then by (14.81) , we have 


\u(t, uj) — u(t', ut/\.)\ < C(t' — t) + CE sup |Mt fc | 

i<k<j 


(4.9) 


Further, by Doob’s inequality, it follows that 
E 


sup \M t n k \ 

L ^k<j 


< JE 


sup \M t h k f 

L i<k<j 


< 2 


Finally, combining the above estimation with (14.71) and (14.91) . we obtain (14.51) . 


Remark 4.3. We here assume that the PPDE is non-degenerate (V 7 G > e > 0). 
When V 7 G = 0 and X7 Z G > 0, the scheme is still monotone. When V 7 G = 0 and 
V Z G < 0 , it is possible to redefine the first order discrete derivative by 


to obtain a monotone scheme. 


^(cutA-) - ^(iO (—Ax)) 

Ax 


Remark 4.4. In the multidimensional case, V 7 G is a matrix. If V 7 G is diagonal 
dominated, then following Kushner and Dupuis EE Chapter 5.3], it is easy to construct 
a monotone scheme under similar CFL condition (14.21) . When V 7 G is not diagonal 
dominated, it is possible to use the generalized finite difference scheme proposed by 
Bonnans, Ottenwaelter and Zidani [2j- 


4.2 The trinomial tree scheme of Guo-Zhang-Zhuo [16 


We consider the PPDE of the form m- Let Co be some symmetric d x d matrix, 
denote 

F(t,u,y,z, 7) := G(t, uj, y, z, 7) - ^ctq : 7, G 7 := a^G^ 1 . 

Let C = (Ci) ''' , Cd) a random vector defined on a probability space (Cl, T, P) such that 
Ci,i = 1, • • • ,d are i.i.d and 

He * = - 7 =) = P(Ci =- 7 =) = ?, HCi = 0 ) = 1 - p, with p e ( 0 , 1 ). 

y/P 2 y/p 2 


For every T't+fe-measurable function ijj : D —>• M, let us define T> % h ip(t, uj) := E ijj(uj <g) 
(Vh&o())Ki(() with 

K 0 ■= 1 K x ■= K 2 ■= <T( ^ 1 ^ 1 ~ 3 ^) Diag t^ T ] “ 2 P J dWt 0 1 


y/h 


(1 ~p)h 


where for any matrix 7 = \li,j\i<i,j<d € Sd, Diag[y] denotes the diagonal matrix whose 
(i,i)-th component is 7 a. Then the numerical scheme is defined as 


T l w [u h (t + h,-)] := V° h u h (t, u) + hF(-,V h u h t+h )(t,uj). 


(4.10) 
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Proposition 4.5. Let Assumptions f^TT] hold true and G is Lipschitz in uj. Suppose 
in addition that Assumption 3.3 in Guo, Zhang and Zhuo m holds true (where we 
replace their notation by V 7 G in our context). Then the trinomial tree scheme 
(14.10p satisfies Assumption \3.7\ 

Proof. The consistency and monotonicity condition in Assumption 13.71 (i) and (ii) can 
be justified by almost the same argument as in m- Similarly to the finite difference 
scheme, the monotonicity in sense of Barles and Souganidis [I] implies the interpre¬ 
tation of the controlled discrete processes of the numerical scheme, which implies the 
monotonicity condition (13.101) in our context. Further, using the same argument as in 
Proposition 14.21 it is easy to show that 

\u h (t,u) - u h {t',d)\ < C^wt/v -4 a .|| + y/\t' -t\), V(t,w),(/,id')e0, 

for some constant C independent of h, which implies in particular (iii) of Assumption 

[ATI ■ 

Remark 4.6. As a PPDE degenerates to be a classical PDE, the conditions in Propo¬ 
sition |T5] turns to be exactly the same conditions in Theorem 3.10 of [16]. 


4.3 The probabilistic scheme of Fahim-Touzi-Warin [14 


We consider PPDE ( 13 . 11 ) in which G is in the form of 

G(t,u,y,z, 7) = (J,{t,u)-z - ^cra r {t,uj) : 7 - F(t,u,y,z, 7). 

Before introducing the numerical scheme, we first define a random vector 

\= /i(t, u)h + a(t,uj)W h , 

where Wh ~ iV(0, hid ) is a Gaussian vector. For every bounded function € L °(Ft+h), 
we define 


V h ip(t, uj) : = E i)j(uj ®t 


where Hh(t,uj) = with 

Ho ■= t, := H } ) := (a T (t, u ;))" 1 to). 

Then the probabilistic scheme is given by 

T T[u h (t + h,-)] := E \u h (t + h,xW)]+hF(-,V h vk h )(t,u). 


(4.11) 


Remark 4.7. The probabilistic scheme in m is inspired by the second order BSDE 
theory of Cheridito, Soner, Touzi and Victoir [5], and extends the classical numerical 
scheme of BSDE (see e.g. Bouchard and Touzi [3], Zhang [33]). In practice, one 
can use the simulation-regression method to estimate the conditional expectation in 
the above scheme (see e.g. Gobet, Lernor and Warm BSD- We refer to Guyon and 
Henry-Labordere m for more details on the use of the scheme, to Tan m for an 
extension to a degenerate case, and to Tan [32] for an extension to path-dependent 
control problems. 
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Assumption 4.8. (i) The nonlinearity F is Lipschtiz w.r.t. (co,u,z,'y) uniformly in 
t and |F(-, •, 0, 0,0)|o < oo. 

(ii) F is elliptic and dominated by the diffusion term of X, that is, 

V 7 F < crcr T , on !lxMx M d x §^. (4-12) 

(iii) V p F € Imagely 1 F) and |(V p F) T (V 7 i ? )" 1 V p F| 0 < oo. 

(iv) |/u.|i, |(t|i < oo and a is invertible and £ is bounded Lipschitz. 

Proposition 4.9. Suppose that Assumption \f.8\ holds true. Then the probabilistic 
numerical scheme (14.111) satisfies Assumption \3. 7[ 

Proof, (i) Assumption 13.71 (i) is obviously satisfied in view of Lemma 3.11 of [T3j. 

(ii) Further, using probabilistic interpretation of this scheme in Tan \T2 . Section 3.2], 
we may verify (ii) of Assumption 13.71 See also the estimation given by Lemma 3.1 of 

m- 

(iii) For (iii)of Assumption ^. 71 we shall prove that the numerical solution u h is Lipschitz 

in co and 1/2-Hdlder in t. In [14] , the authors proved this property in the case of PDEs. 
Their arguments for the Lipschitz continuity in co can be easily adapted to this path- 
dependent case. For the regularity of u h in t, they used a regularization technique, 
which seems impossible to be adapted to the path-dependent case. However, we can 
still use similar arguments as in Proposition 14.21 i.e. use the discrete-time controlled 
senrimartingale interpretation, to prove the Holder property of u h in t. ■ 

Remark 4.10. As a PPDE degenerates to be a PDE, the conditions in Assumption 
14.81 reduce exactly the same conditions as in [14 ] (see their Theorem 3.6). 

4.4 The semi-Lagrangian scheme 

For the semi-Lagrangian scheme, we shall consider the PPDE (13.11) of the Bellman-Issac 
type, i.e. the function G is in the form of 

G(t,u,y,z, 7 ) = inf sup (V’ fc 2 (.) : 7 + b k ^f)-z + c k ^(-)y + (*,w), 

ki&Kx k 2 eK 2 y 2 ' 

where K\ and K 2 are some sets, (a kl,k2 , b kl,k2 , c kl,k2 , / fe i> fc2 ) are functionals defined on 

0 . 

Let ( be a random vector satisfying 

E[C]=0, Var[C]=/ d and IE[|C| 3 ] < 00 . (4.13) 

Then the semi-Lagrangian scheme is defined as 

T+/i, •)] := inf sup \u h (t + h, co <g>t (<7 fel,fc2 (i, co)(Vh + b kl,k2 (t, co)h)) 

fcieKi k 2 eK 2 *- 

+ u h (t + h, co)c kl,k2 (t,co)h + f^(t,uo)h}. (4.14) 
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Proposition 4.11. Suppose that |a|i + |6|i + |c|i + |/|i < oo, and (14.131) holds true. 
Then the semi-Lagrangian scheme (|4.14l) for the Bellman-Issac path-dependent equa¬ 
tion satisfies Assumption m 

Proof, (i) The consistency condition (Assumption 13.71 fill is easy to check. 

(ii) Let E be a set, e : K\ x K 2 —>• E be an arbitrary mapping, and if, ip : E —» R be 
two bounded functions. Note that 

inf sup ip(e(k \, kfi)) — inf sup (p(e(k\, /C 2 )) < sup — ip){e(k\, k 2 )\&- 15) 

ki&Ki k 2 £K 2 k 2 &K 2 fci &K lt k2eK2 

Notice that is isomorphic to M, we can always consider the random vector a kl,k2 f\/h-\- 
b kl,k2 h as a one-dimensional random variable. By consider the inverse function of its 
distribution function, then there is a family ^(Aq, & 2 , •) such that ,U) ~ 

a kl,k2 fy/h + b kl,k2 h in law with U ~ £7([0,1]), for all ( k\. hi ) € K\ x I\- 2 . Then it 
follows from (14.151) that the monotonicity condition in Assumption 13.71 (ii) holds true 
with &h(k\, k 2 , ■) and K = K\ x K 2 . 

(iii) Finally, by the same arguments as in Proposition 14.21 we can easily deduce that 

u h is Lipschitz in cj and 1/2-Holder in t, uniformly on h, and hence complete the proof 
for the stability condition in Assumption 13.71 ■ 

Remark 4.12. Solutions of path dependent Bellman-Issac equations can characterize 
value functions of stochastic differential games (see e.g. Pham and Zhang »■ 

Remark 4.13. (i) For Bellman-Issac PDE, Debrabant and Jakobsen [6] studied the 
semi-Lagrangian scheme with a random variable £ following a discrete distribution, 
together with an interpolation technique for the implementation. 

(ii) For Bellman equation (PDE), Kharroubi, Langrene and Pham [20J propose a 
semi-Lagrangian type numerical scheme with £ ~ 1V(0,1), and provide a simulation- 
regression technique for the implementation. It is worth of mentioning that [20] pro¬ 
vides a convergence rate for the scheme, while we only prove in this paper a general 
convergence theorem as in Barles and Souganidis p.]. 

5 Numerical examples 

We will provide two toy examples of numerical implementation in low-dimensional 
case. Notice also that the main focus of the paper is on a general convergence theorem 
for numerical analysis of non-Markovian control problems, and we will not propose 
any new numerical schemes. For more numerical examples (in high-dimensional case) 
of difference numerical schemes, we would like to refer to mmmmm , etc. 

In our two toy examples, we implement the finite difference scheme in Section 14.11 
and the probabilistic scheme in Section 14.31 In this low dimensional case, the finite 
difference scheme is quite easy to be implemented given some boundary conditions. 
For the probabilistic scheme, we do not need the boundary conditions, but need a 
simulation-regression technique (as studied in Gobet, Lemor and Warin m) to esti¬ 
mate the conditional expectations appearing in the scheme. More concretely, we will 
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use the local polynomial functions as regression basis, as introduced by Bouchard and 
Warin [4|. 

A first numerical example For a first numerical example, we consider the PPDE 
-d t u- min_ fj,d u u - max ^-d^u = u(T, u) = g(u T , O t )- (5.1) 

a£\a,a] Z 

where d = 1, u>t : = f^Ldsds, f : [0,T]xlxl-}R and g : R x R —X R are two 
functions. In this case, the value function dependents only on (), so that the 
numerical solution can be written as u h (t,u!t,LJt). 

The above PPDE (15.11) is motivated by a stochastic differential game: 

u 0 = inf _ sup E / f(t,Xl l ’ a ,X fl,a )dt + g(Xfi a ,X% a ) , 
a<at<a '-Jo 

where is controlled diffusion such that 

Xt’ a = / g s ds + / y/~cT s dW s , with W a Brownian motion, 

Jo Jo 

and X l ‘ t ' n = f*Xs’ a ds (see e.g. Pham and Zhang [21] for more details). 

We choose the terminal condition g(x,y) = cos(x + y) and the function 

f{t,x,y) = -(z-/£)(sin (x - y))~ + (x + Jl)(sm(x - y)) + 

+ f(cos(x-y)) + - |(cos (x-y))~, 

so that the solution to PPDE (15.11) is given explicitly by u(t, ui) = cos(uJt + (*;*), which 
serves as a reference value for the numerical examples (this idea is borrowed from 
Guo, Zhang and Zhuo [16]). For finite difference scheme, we use cos(cut + Qt) as 
boundary conditions since it is the exact solution of the PPDE. For the probabilistic 
scheme, we simulate 100 000 paths (X fc )fc=i,... ,ioo ooo °f a diffusion process on discrete 
time grids. The diffusion process X is defined by dXt = y/adWt, with a Brownian 
motion W, and also denote At := f 0 X s ds. Then for regression function basis, we 
use the local polynomial of order 2 (as introduced in 0]), i.e. uif ,cj|, uJiuJt on 

each local hypercube. To define the local hypercube, we will find the minimum and 
maximum of Xt as well as At of all simulations, and then divide uniformly the domain 
[rniri^. Xj\ rriax^. X^] x [rniri/. A^f . max*. A^] into 20 x 28 small hypercubes. 

A second numerical example The second example of PPDE we considered is 
given by 

-d t u - maxa< a <a (jad^u - f(t, u, d u u , a)) = 0, (5.2) 

where f(t, y, z, a) = ^((-y/az + b/y/a)~Y — zb — b 2 /2a, 

which is taken from Matoussi, Possamai and Zhou [22]. The above equation is moti¬ 
vated by solving a robust utility maximization problem using 2BSDE, which can be 
instead characterized by a PPDE (see e.g. (13.31) '). 
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Numerical Error 


x 10" 3 



Figure 1: For PPDE fl5.ll) . we choose /z = —0.2, Ji = 0.2, a = 0.04, a = 0.09, T — 1 and 
co 0 =ZJ 0 = 0. Then the reference solution is given by n(0, 0) = cos(0) = 1. We compute the 
error between the reference solution and the numerical solutions, w.r.t. difference time step 
length At. 

We consider the terminal condition 

u(T,u) = Ki + (Q t - Ki) + - (Q t - K 2 ) + , uJt ■= f u s ds. 

Jo 

Then the solution to PPDE (|5.2p can also be characterized by the PDE, by adding an 
associated variable y, 

-d t v - xd y v - maXa<a<a {\adl x v - f(t, v, d x v, a)^j = 0, (5.3) 

v(T, x, y) = R\ + {y- Ki) + - (y - K 2 ) + . 

We implemented the finite difference scheme (Section 14.11) and the probabilistic 
scheme (Section 14.31) for PPDE (15.21) . As reference, we implemented the classical finite 
difference scheme of PDE (15.31) . Here for the finite difference scheme, we fixe the 
computation domain as [—0.8,0.8] x [—0.8,0.8], and use a Active Neumann boundary 
conditions d x u(t, x, a) = 0 for x = ±0.8 and a Active Dirichlet boundary conditions 
u(t,x, — 0.8) = K\ and u(t,x, 0.8) = K 2 . For the probabilistic scheme, we use the 
same simulation-regression techniques as previous PPDE to estimate the conditional 
expectations appearing in the scheme. We also notice that the generator in PPDE (15.21) 
is in fact not Lipschitz but quadratic in z, however, the convergence of the numerical 
solutions can be still observed, see Figure El 
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Numerical result 



Figure 2: For PPDE (15.11) . we choose K\ = —0.2, K 2 = 0.2, a = 0.04, a = 0.09, b = 0.05 
and T = 1. We provide all the numerical solutions w.r.t. difference time step length At. It 
seems that the faire value is closed to 0.129. For Unite-difference scheme, when At is greater 
than 0.025, we need to use a coarser space-discretization to ensure the monotonicity (similar 
to the classical CFL condition), which makes a big difference to the numerical solutions for 
the case At < 0.25. However, the convergence as At —>■ 0 is still obvious. 

6 Proofs 

6.1 Preliminary results 

In preparation of the proof of Theorem 13.91 we prove the following lemmas. 

Lemma 6.1 (Fatou’s Lemma). Assume that the random variables X n € C°(J-) are 
uniformly bounded. Then we have 

lim £[X n ] > £[ lim X n } 

n—>• oo n—>• oo 

Proof. In order to prove Fatou’s lemma, it is enough to show the monotone conver¬ 
gence theorem, i.e. given a sequence {X n : n € N} of increasing random variables, we 
have 


lim £[X n ] =£[lim X n }. (6.1) 

n—>oo 7i—> oo 

Since X n € C'°(J r ) for each n , it follows from Theorem 31 in [7] that dsm holds true. 
Recall the nonlinear expectation £_ h defined in (13.71) . 
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Lemma 6.2. Let p : fl —» R be bounded uniformly continuous. Then there exists a 
modulus of continuity p : M + —>• M + which depends only on the moduli of continuity of 
ip and \ip\$, such that 


£[<P] < £-h[p\+p( h )- 

Proof. Denote p' : M+ —>• as a continuity modulus of ip. Let v E K. and X h,u be 

defined by (13.61) and X h,u its linear interpolation on [0,T], Then under the condition 
(13.51) . it follows from Lemma 4.8 of Tan [32] (see also Dolinsky [8]) that we can construct 
a process X h,u and another process X in the same probability space (Ll,X, P), such 
that the image measure of X lies in V, and for some constant C independent of h, 

¥(jX h ’ v -X\ > h 1/8 ) < Ch 1/8 . 

Let p(h) := p'{h 1 / 8 ) + 2||<^|| 0O /i 1 / 8 , then it follows that 

[p(X)]<t[p(X h ^)\+p(h), 

which concludes the proof by the arbitrariness of v € X. ■ 

Lemma 6.3. Let ip : LI —> R be lower semicontinuous and bounded from below, then 
it holds for all (t,ui) € 0 that 


h->0 

In particular, by defining H := inf{t > 0 : 


> £[p\. 

\B t \ > x } for some x > 0, we have 


lim^[l {H < 5} ] < ^[1 { h <5}] 


for any 5 > 0. 


Proof. Define the approximation for the function tp: 


P n (u) := ien &{“') + n\\u - u/||}. 

Clearly, for each n € N, function (p n is Lipschitz continuous, and ip n f ip. By Lemma 
16.21 we obtain that 


lim £_ h [p\ > Y\m.£_ h [p n ] > £_[p n ], for all n € N. 
o h ^° 


Since ip 11 t P, by Fatou’s lemma we have 


lim £_[p n ] > £\p\. 

n—>-oo 


Therefore 


\MfLh\p\ > £[p\- 

h-+ 0 


( 6 . 2 ) 


Then we easily get the symmetric result for upper semicontinuous function if, i.e. 


lim £ h [if] < S[p\. 
/i—> o 
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To conclude, it remains to prove that the function uj \—> l{ H (o;)<a} is upper semicon- 
tinuous. Note that 


{h < <5j = | max \BA > xi 
te[o,<5] 

Since the function ip : uj max tG r 0 ^ \B t (uj)\ is continuous, the set {h < <5} is closed. 
Consequently, the function 1{ H <<5} is upper semicontinuous. ■ 


Lemma 6.4. For any 5 > 0 and e > 0, define x(5) = Ldy/5(y/5 + y — 21n|^) and 
H'i = inf{t > 0 : \Bt\ > x(5)}. Then, for 5 small enough we have 

sup P[h 5 < 5] < ed. (6.3) 

Per 

Proof. Note that 


supPfH 5 < (51 = supP[ max \BA > xl < dsupPf max \B}\ > — 
Per Per L te[o,<5] 4e[o,5] d 


By the definition of V above (12.11) . for all P£P, the canonical process B admits the 
canonical decomposition B = A p + M F , where A® = ( A 1 , • • • , A d ) is a finite variation 
process and M = (M 1 , • • • , M d ) is a P-martingale. Moreover, for each i = 1, • • • ,d, 



Further, by the time-change for martingales (see e.g. Theorem 4.6 on page 174 of m), 
there is a scalar Brownian motion W defined on a probability space (fi, F, P) such that 


P[ max I Mi I > — 
L *e[o, 5 ] ~d 


LS] = P[max|»' <M1>1 |>--M] 


= 4P[lTi> 


x 
d 

x/d — L5-, 


< P I" max I WA > — — L6] 
l te[o,L 2 s] A J 


lVs 


Since r] : = 


x/d—LS 

lVs 


—2 In |4 > 1 when 5 is small enough, we have 


4P[FFi >v\< 4e - ^ 


eS_ 

~d' 


We then conclude that supp g -p P[h 5 < 5] < e5. 


6.2 Proof of Proposition 13.4 

We only discuss the case of subsolution. The result about the supersolution follows 
similarly. 

1. We first prove the only if part. Let (t,oj) € [0, T) x O and (a,/3, 7 ) € Ju(f,w) 
with a localizing time H^. Clearly, there is a function <p € Cq (M + x R d ) such that 
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ip = cj) a ’P’' 1 on the set [0,5] x {x € : |x| < x(<5)}, where x(-) is dehned as in Lemma 

16.41 Thus, 

(ip — u) o= max £[(ip — u) T \, 
t£T s 5,x 

where H* 5 ’* := 5 A H^ ,a: with H ' 5 ’ 1 be defined as in Lemma 16.41 We have 

(^-u ) 0 > £[(ip-u)s\-£[(ip-u)s-(ip-u)^]. (6.4) 

For the second term on the right hand side of (16.41) . we have 

£[(ip - u)s -(ip- u) n s,x\ < £[\(ip - u) s - (ip - u) n s,x\;H S ’ x < 8] 

< Csu P P[h 5 ’ x < 5], 

PeV 

Take e > 0. By Lemma [6.41 there is a constant C(e) > 0 such that for all 5 < C(e) we 
have sup Pg -p P[h 5,3: < 5] < Then it follows from (16.41) that 

sS 

(<P-u )0 >S[(<p-u)s] ~ —■ 

We next consider the optimal stopping problem: 

Y t (u) = sup £[(ip - u)^ - et\. 
r&Ts-t 

According to Ekren, Touzi and Zhang DU , t* : = inf{t : Y t = pt~Ut — £t} is an optimal 
stopping rule. Suppose that we always have th 5 ’* < t* < 5. Then we obtain that 


£[(ip — u) T * — £T*] < 

< 
< 

< 


£[(ip - u)s - e5] + £[(tp - u) T * - (ip - u) s - e(r* - 5)] 

£[(ip - u)s - eS\ + £[\(p - u) T * - (ip- u)s - e(r* - 5)|; h 5,1 < 5] 

£[(ip — u)s — e§\+ C sup P[H 5,a: < 5 ] 

Pe"P 

sS 

£[(ip-u) s \ - — < (ip-u ) 0 . 


However, this is in contradiction with the optimality of r*. Therefore, there is uj* such 
that t* := T*(uj*) < H d >(w*) and 


(p> — u)t*(oo*) = max £[(ip — — er\. 

T £T 5 _t* 


So we have 


(-d t ip + £-G(-,u,d x ip,dl x ip))(t*,uj*) < 0. 

By letting 5 —>• 0 and then e —>• 0, we obtain 

(-dttp-G(-,u,d x tp,d% x tp))( 0 , 0 ) < 0 . 

Finally, since a = dtpo, /3 = d x cpo, 7 = d xx ipo, this provides that —a—G( 0, uq, (3, 7 ) < 0. 
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2. For the if part, one may apply the same argument as in Proposition 3.11 in [ 26] . 
For completeness, we provide the full argument. Let (t, ui) G [0, T) x Q and ip G Au(t, u) 
with a localizing time 6 G M + . Without loss of generality, we assume that (t, u>) = (0, 0) 
and (<p — u )o = 0. Denote 

a := d t f o, P '■= d x ip 0 , and 7 := d xx ip 0 . (6.5) 


For any e > 0, since f is smooth, by otherwise choosing a stopping time Hy < S we 
may assume 

\d t ft-a\<e, \d x (ft — ( 3 \ < e, \dl x (p t -'y\<2e, 0 < t < h 5 /. 

Denote a e := a + [1 + 2 L\e. Then, for all t g Th_,, 

F[(n - - n 0 = F[(n - n 0 - ^ a ‘^) T ] 

< £ [(u-(f) T ] +£[((f-<f 0 -p ae ’^' y )T] 


f (dtfs —OL e )ds + (d x ip s - P) ■ dB s + \ (dl x tp s - 7 ) : d(B) t 

Jo 1 


< £ 


where the last inequality is due to the Ito’s formula. Note that, for any ||/r||oo> IMloo < 
L, we have 


r 1 

/ (dtf s —a £ )ds + (d x ip s - P) ■ dB s + -(d% x <p s - 7 ) : 
Jo 1 


d(B) s 


- TLTV/x.o- 


- ot + (d x <p s -P)-fj, s + ~(d xx if s - 7 ) : a s )ds - [1 + 2L\et 


< 0 . 


By the arbitrariness of fi, a, we see that 

£[(u - 0 Qe ’ /3 ’ 7 ) T ] - n 0 < 0 . 

That is, ( a e ,P ) G J_uq. Since n is a P-viscosity subsolution, it follows that 

—a £ — G( 0 ,0, uq,P, 7 ) < 0 . 


Let e —> 0, then the desired result follows. 


6.3 Proof of Theorem 13.9 

We first introduce two functions: 

u(t, u) = lim u h (t,u) and u(t, u) = lim u h (t, u). ( 6 . 6 ) 

h-> 0 h ^° 

Note that n, n inherit the uniform modulus of continuity of u h , so n, n G BUC(@). It is 
also clear that u < u and u T = ut■ Then it is enough to prove that u is a V -viscosity 
supersolution and n is a P-viscosity subsolution, so that by the comparison principle 
we may obtain n < n, to conclude the proof of Theorem 13.91 
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Proposition 6.5. The functions u and u defined in (|6.6D are V-viscosity supersolution 
and subsolution, respectively. 

Proof. We only prove the result for u. The corresponding result for u can be proved 
similarly. 

1. Without loss of generality, we only verify the viscosity supersolution property at 
the point (0, 0). Let function ip € Au(0, 0), and by adding a constant to ip, we assume 
that u(0,0) > p(0, 0), so that 


0 < r) =: (u — p )o = min £\[u — p) T \, for some 6 > 0. (6.7) 

r&Ts 


Assume that u and ip are both bounded by a constant M > 0. Take a subsequence 
still named as u h such that u 0 = lim/^o ^o- Now fix a constant e > 0, and denote 
p £ (t,x) = <p(t,x) — et. By Lemma l6~71 there is a constant C(e) € (0, A 1) such that 
for all 0 < 5 < C(e), we have 


su P P[h 5 ’ x < 5 \ < 

vev 


e 

32(2 M + e) 


5. 


( 6 . 8 ) 


Since u h is uniformly continuous uniformly in h, by considering 5 small enough we 
may assume that u h — <p £ > 0 on [0, H 5 ’ 1 ], where h 5,3: := 5 A n S ' x . It follows from (16.71) 
that 


(u - <p £ )o < £_[{u ~ p)s\ = £[{u ~ T e )s\ ~ (6.9) 

It follows from (iii) of Assumption 13.71 that — <p £ s : h > 0} is uniformly bounded 
and uniformly continuous uniformly in h. By Lemma 16.11 and 16.21 we obtain that 


lim hi H ~ vf\ > lim L [«* - Ts] + 1™ {hi [ U S ~ P?] -£[«*- vf\ ) 


h,-* 0 


h—>0 


h-> 0 


> £[m - Ts] + lim jnf (£ h [u £ s - p £ s \ -£[u l 5 - p £ s \ ) ( 6 . 10 ) 

h->0 i>0 

> £[us - Tf\ + lim p(h) = £[us - Ts] ■ 

0 


It follows from (|6.8p and (|6.10p that for h sufficiently small we have 

(u h -v‘) a < £ h [(n h - V c )l\-^- 


( 6 . 11 ) 


Then by the optimal stopping argument in Step 2, we may find (t*,u*) € 0 such that 


H*-*(w*) A (6 - h) > t* € A h := {kh : k € N} 
and (u h -ip £ )= min reT fc_^ peB h £ h [fir{u h - p £ )\ ], (6.12) 

where T s h _ t * := {r G Ts~t* '■ t takes values in A^} and B h is the collection of all 

processes fi defined by fit '■= e^=o ai for some Ti^-measurable functions ck* taking 
value in [0,L], In particular, (16.12|) implies that 

(u h -p £ )(t*,uj*) < inf T £ h [e ah (u h ~ p £ )h’ w *}- (6.13) 
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Since t* < H rt ’ x (w*), we have (u h — ip £ )(t*, lu*) > 0, and thus 


h ,rs£\( + * / ,*> 


sup e ah (u h — <p £ )(t*, lo*) = e Lh (u h — tp £ )(t* ,lu*). 

0 <a<L 

So it follows from (16.131) that 

0 < 0< mf t £ k [e“ h ((u h -»>')£'"• -e- Lh (u h -v ! )(t\^ 

By (ii) of Assumption 13.71 we obtain 

0 < . +h + e- Lh (u h - v ’)(t\^)\ + hS(h)- 

Since u h (t*,uj*) = ,UJ [u h ], it follows that 

^*W E t* +h + e~ Lh (u h - - u h (t*,u*) 


5(h) > 


h 

T h’^iVr+h + e~ Lh (u h - <p £ )(t*,uj*)\ - <p £ (t*,uj*) + e~ Lh (y £ - u h )(t*,uj*) 

h 

(e~ Lh - 1 )(p £ -u h )(t*,u*) 

h 

Since t* < h'^u;*), we have (t*,ui*) —>• 0 as 5 —> 0, and note that 

lim \u h (t*,uj*) — u 0 | < lim (p u (d((t*, u*), (0,0))) + \uq — UqI) = 0, (6.15) 

>0 <5,/i—>-0 V / 

where p u is the common modulus of continuity of the functions u h . Further, by (16.141) 
and (16.151) . it follows from (i) of Assumption 13.71 

0 < -dtyQ + £-G(Q,<po+yQ-w Q ,d x y Q ,(% x yo)-L(wl-u Q ) 

= -dtWo + e-G(Q,u 0 ,d x y Q ,dl x ip Q )-Lr). 

Finally, we conclude the proof by letting e —» 0 and then 77 —>• 0. 

2. We now complete the proof of the claim (16.121) . Consider the mixed control and 
optimal stopping problem in finite discrete-time: 

Y t h (u) := inf £ h [/3 r (Z h )^}, where Z t h := (u h - ^) t , t G A h . (6.16) 
r e7^_ t ,/3eB 

By standard argument, we have 

Y 0 h = inf £ h [P T *Z^}, where r* := inf{t € A h : Y t h = Z t h }. 


(6.14) 


It remains to prove that there exists cu* such that 

t* := t*(lo*) < h S ’ x (cj*)A (5-h). 


(6.17) 
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Recall that 0 < Z h < 2M + e on [0, h 5,3: ] for h small enough. Then since r* < 5, we 
have 


£ h [Z^} < £ h [Z^n s ’ x >6}+£ h [Z^,n s ’ x <S] 

= inf £ h [/3 r * Z^ ; H^ ,x > <5] + £ h [Z^ ; H 5 ’* < S\ 

< inf £ h [/3 t *Z*] + sup £[f3 T * \Z*.\; H^’ x <6}+£ h [| Z *. |; H*>* < 5] 

/3£6 /3eB 

< Y 0 h + (l + e L5 )£ h [\Z^\;n S ’ x <6] 

< Yo + (1 + e LS )(2M + e)£ h [l {h ^< 5} ], (6.18) 

On the other hand, we obtain from Lemma 16.31 that for h small enough it holds 


eS 


(6.19) 


£/i[1{h 5 . :c <( 5}] < ^[-*-{H ,5 ’ a: <(5}] + _|_ 2e) ’ 

It follows from (16.181) and (16.191) that 

£.h{ZrA < Yo + (1 + e L5 )(2M + £)£[1{hM<(S}] + 

Further, it follows from (16.8j) that (1 + e LS ){2M + e)£[l{ H ,s,*<,$}.] < Therefore, 

( 6 . 20 ) 

Suppose that contrary to (|6.171) we have 

h 5,x (u;) A (5 — h) < t*{uj) < 5 , for all oj. (6.21) 


y» > f ■ 


Note that 

£ h [Z^} > £ h [Z%] +£ h [Z^ - Z^ v{s _ h) ] + £ h [Z^ w(s _ h) - Z%]. (6.22) 

It follows from (16.81) and (16.191) that 

h ■= £ h [Z^-Z^ v{s _ h) \ = £ h [Z^-Zl h -r* <5-h] (6.23) 

sS sS 

> — (4M + 2e)£i/ l [l| H 5,a:< ( 5}.] > — (4M + 2e)f’[l| H 5, a; < ( 5j] — > 

On the other hand, we have 

h := SjZj.vfJ-A) - Zj] 

> — £h\{Pu. + Pp)(h + 2||B(6_/ t , A . - B§^. ID] — E h, (6-24) 

where p u , p v are moduli of continuity of function u h , tp, and are chosen to be bounded 
and continuous. Again by Lemma 16.31 we have for h sufficiently small that 

sS 

£h [(Pu + P<p)(h + 2\\B(s_ h )/\. — Bs/\. |D] < £\{pu + P<p)(h + 2||R(5_/i) A . — B$ A . ||)] + — 

r 

= £\(Pu + Pip)(h + 2\\Bf l /\.\\\ +—, (6.25) 
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(6.26) 


It follows from (16.24p . (16.251) and lim^o £ \(p u + Pv)(h + 2||i?/ lA .||] = 0 that 

sS 

I 2 > —— for h sufficiently small. 

Plugging the estimates of (|6.23l) and (16.261) into (16.221) . we obtain 

£,.[Z t \] > £*[Z s k ] - y. (6.27) 

Finally, by (16.111) . (16.201) and (16.271) we have 

Y« h > ^ > zl 

which contradicts the definition of Y in (16.16|) . Therefore, (16.211) is wrong. The proof 
is complete. ■ 


7 Conclusion 

We provide a convergence theorem of monotone numerical schemes for a class of 
parabolic PPDE, which generalizes the classical convergence theorem of Barles and 
Souganidis pQ. In contrast to the formulation of [34J, our conditions are satisfied 
by all classical monotone numerical scheme for PDEs, to the best of our knowledge. 
Moreover, our results permit to deduce some numerical schemes for path-dependent 
stochastic differential game problems and the second order BSDEs whose generator 
depends on z (see (13.31) . (13.41) 1. which are new in literatures. 

Other numerical schemes, such as the branching process scheme of Henry-Labordere, 
Tan and Touzi m, are possible for some PPDE, but it is not analyzed by the monotone 
scheme arguments. 
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